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ABSTRACT 

Results of a subtest of the Project Access battery, 
comparing the influence of race, sex and city on inductive reasoning 
items, are presented. The participating Junior High students 
represented three racial groups. Black, White, and Mexican Americans, 
from three cities, Los Angeles, Memphis, and Washington, D. C. The 
test, entitled Letter Groups, contained 25 vowel/ consonant items 
instructing the student to find the rule which related four of a set 
of five to each other. The correct answer was a single unrelated set. 
Results indicated that the majority group (Whites) fared better than 
did the minority groups (Mexican Americans or Blacks) ; comparisons by 
city, whether between race or within race, indicated the best 
performing group was the Memphis Whites, and the second best the D. 

C. Blacks; and comparisons by sex indicated close performance 
patterns between males and females, but wherever significant 
differences did occur, it was the female who was favored. 
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PROJECT ACCESS RESEARCH REPORT #U 

Influence of Race, Sex and City on Inductive Reasoning Items 
Alfred H. Gitlitz and Nadeen L. Kaufman 
College Entrance Examination Board 

Project Access is a program of the College Entrance Examination 
Board that has received financial support from the Ford Foundation. 

Parts of the program are conducted for the Board ty Educational Testing 
Service. The goal of Project Access is to increase the access to post- 
secondary education for minority/poverty students. It is also the intent 
of the Board and ETS to apply the knowledge gained in this endeavor to 
other testing and measurement activities that affect these students. 

In the 1969-70 school year, a nine-test Project Access battery was 
administered, together with a Biographical Inventory, to approximately 
18,000 junior year students in three cities: Los Angeles, Memphis, and 

Washington, D.C. Within each city, schools were chosen on the basis of 
interest and willingness to participate. 

This study is concerned with one of the nine subtests in the battery, 
a test of inductive reasoning entitled Letter Groups. This test contained 
25 items, and 15 minutes were allowed for completion. For each item, five 
sets of four letters each were presented. The student was instructed to 
find the rule which relates four of the sets to each other; the correct 
answer is the single set which does not fit the rule. 

There are three sources of interest in analyzing this particular sub- 
test of the Project Access battery: (l) Flaugher (l97l) found that the 

difference in performance on this test between Black and White students was 
somewhat less than the discrepancies found in the Vocabulary and Mathematics 
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tests. A similar but less pronounced trend was also found between Mexican- 
American and White students. As Flaugher pointed out, "the fact that the 
trend did occur in most of the situations where it was possible would 
indicate that some non-chance influence is at work and that these differ- 
ences deserve further consideration." 

(2) Any change in this test that would reduce the difference in per- 
formance of students from different ethnic backgrounds could be of great 
consequence to a large number of students. Flaugher (1971) pointed out that 

because of the very large numbers of students involved in national testing 
programs , 

even slight differences in test score can be of conse- 
quence to a great many students, particularly in set- 
tings of competition for postsecondary educational 
opportunities. For example, on the basis of these 
results, the consequences of utilizing Letter Groups 
in a testing program, either in addition to the tra- 
ditional verbal and math measures or as a substitute 
for one of them, would be higher scores for many Black 
and Mexican-American students. 

(3) If differences in performance of students from different ethnic 
backgrounds could be reduced, the correlation between the test and ethnic 
membership would be reduced. If the differences could be completely elimi- 
nated, thus the correlation between "culture" and the test becomes zero, the 
test would then be "culturally fair" by Darlington's (1971) most rigorous 
definition (definition k). 

This analysis, therefore, attempts to examine, by means of item analysis 
techniques, the possible causes of the discrepancies in performance on the 
Letter Groups test by various groups. 



METHODOLOGY 



The strategy was to look at the 25 Letter Groups items and determine 
whether or not they could be further categorized into subgroups on the basis 

3 
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of the particular cognitive tasks demanded in the solution of the item. 
Analyses consisted of comparisons of item Deltas' 1 ', hy race, by city, by 
sex, and by race and city, to determine whether certain item "categories" 
were differentially more difficult (had higher Deltas) for some groups 
than were other item "categories." 



Description of Item Categories 

The Letter Groups test was given to three professionals in psycholog- 
ical measurement who were instructed to group the items into as many cate- 
gories as each independently felt was necessary. Despite a difference in 
nomenclature, the groups which each arrived at were virtually identical, 
thus ensuring, in an informal way, the reliability of the categories which 
are presented below. 



A. Type of Letters involves the utilization of a "commonly known" fact 
to be incorporated in the respondent's choice. Two items (numbers 8 and 25) 
represent this grouping. Item 8 (CAEZ CEIZ CIOZ CGUZ CAUZ) requires the 
examinee to know the rules governing vowels and consonants, and to choose 

the one that does not have a middle pair of vowels. Item 25 (AOUI CTZR 

• • • • 

JHTN PBRL RTVH) requires the, examinee to choose the only grouping of letters 



^elta is the index of item difficulty customarily used by Educa- 
tional Testing Service. It is defined by the relation Delta - 13 + UZ, 
where Z is the normal deviate corresponding to the proportion of persons 
who got the item right. When the proportion is greater than .50, Z is less 
than 0; when the proportion is less than .50, Z is greater than 0. When 
the number attempting the item is less than the total sample, a correction 
is made for ability change of the group. Number attempting includes number 
right , number wrong, and number omitting, but excludes number not reaching 
the item. 
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that are not all consonants. Both of these items focus attention on the 
vowel-consonant dichotomy and not on the test— taker's basic ability to 
order letters alphabetically. 

B. Repeated Patterns is a category of items that presents the exam- 
inee with a rule or pattern which is repeated and challenges him to pick 
out the grouping which violates the existing pattern. Included in this 
category are seven items (l, U, 6, 10, 12, 13, and 18) . For example, item 

13 (ABCX EFGX IJKX OPQX UVWZ) sets the constant end letter of "X" on 

• • • • 

all valid groups. The fact that the letters are in alphabetical order is 
irrelevant; it is the repeated variable of a tail " X" in four of the letter 
groups which establishes the pattern in this particular item. 

C. Order of Letters — Whole Patterns deals with all four letters of 

a sample group and some kind of alphabetical order. It emphasizes a Gestalt 
view of the entire tetrad. Eight items (3, 5, 9, l 1 *, 17, 19, 20, and 22) comprise 
this category. Item 9, for example (BDEF FHIJ HJKL NPQR SVWX) , requires 
the respondent to study all four letters in deciding what the alphabetical 
pattern established encompasses. In this case the letter following the first 
in each group is skipped, but the other three follow the continued alphabeti- 
cal progression. 

D. Order of Letters — Partial Patterns also involves specific alpha- 
betical patterning, but splits the four letters up into two groups requiring 
the examinee not to incorporate all four letters into his answering process 
at one time. This group consists of seven items (2,7,11, 15,16,21, and 2k). 
In item 21, for example (CERT KMTV FHXZ BODQ HJPR) , each letter group 
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has two parts (first two letters and last two letters) in separate alpha- 
betical order where the middle letter is skipped; i.e., C (D) E, R (s) T; 

K (L) M, T (U) V; etc. Although all four letters are involved, the 
respondent must focus on first one part and then the other part of the 
group rather than study the group in its entirety, as is the case in 
category C. 

E. Total Gestalt of Repeated Patterns is a category composed of 
item 23 alone. This grouping combines elements of three other categories, 

B, C, and D. The examinee is required to find a repeated pattern, as is 
the case with category B, and part of each letter group is involved (cate- 
gory D); alphabetical order is utilized (categories C and D). What makes 
this category different is that letter groups are not separate entities in 
themselves, but must be viewed as part of a total Gestalt. For example, 

item 23 (PXCC EEQX RXGG USX TXLL) maintains a double letter in each 

• • • • 

letter group which happens to be part of an alphabetical progression across 
groups: CC (skip the letter D) ; EE (skip the letter F) ; GG (skip the letter 

H) ; II (skip the letter j); etc. 

Classification of Item Difficulty Levels 

Once categorized, the items were further classified by their diffi- 
culty levels. Mean Deltas were computed for each item on the basis of data 
obtained on the following groups: (l) Los Angeles: Mexican-Americans 

(Total); (2) Los Angeles: Whites (Total); (3) Los Angeles: Blacks (To- 
tal); (U) Memphis: Whites (Total); (5) Memphis: Blacks (Total); and (6) 

Washington, D.C.: Blacks (Total). The items were ranked according to their 



6 



- 6 - 



mean Deltas and were then divided into the three approximately equal 
groups of Easy, Medium, and Hard. Table I shows which items, by cate- 
gory,belonged at each level of difficulty. It is interesting to note 
that with only one exception (item 3), all Easy items were of Type B 
classification. 



RESULTS 

The data obtained from each group participating in the Project Ac- 
cess administration were analyzed in the form of lU different group com- 
parisons. These lU comparisons break down into four natural divisions: 

(l) comparisons by race, (2) comparisons by city, (3) comparisons by 
sex, and (U) comparisons by race and city combined. The results for 
each of these divisions will be discussed separately. 

1* Comparisons by race . Under this division four comparisons were 
performed: 

(a) L.A. Blacks versus Whites 

(b) L.A. Mexican-Americans versus Whites 

(c) L.A. Blacks versus Mexican-Americans 

(d) Memphis Blacks versus Whites 

There were 72 possible comparisons between majority (White) and minor- 

2 

ity (Black or Mexican-American) performance on items. Of these, there 



This number is arrived at by multiplying the number of items by the 
number of comparisons considered. The majority vs. minority analysis in- 
cluded three comparison groups: L.A. Whites vs. L.A. Blacks; L.A. Whites 

vs. L.A. Mexican-Americans; Memphis Whites vs. Memphis Blacks. Whereas Let- 
ter Groups is a 25-item test, only 2k items were utilized in computations; 
item 25 had to be eliminated from most analyses due to insufficient data. 
Thus, if one multiplies the 2k items by the three comparison groups, 72 
possible chances for item discrepancy will emerge between majority and minor- 
ity groups. 
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were 1*2 significant 13 differences, all in favor of the majority group, (See 
Tables II and III.) However, more than half of these ( 2k of the 1*2) were 
attributable to the much higher scores achieved by the White groups in Mem- 
phis, which resulted in significant differences on all items in the test. 

A certain pattern emerges from these comparisons of majority versus 
minority groups. Of the 8 category C items, 17 out of a possible 2h chances 
showed significant differences in favor of the majority group. Out of 
the 7 category D items, 13 out of a possible 21 chances showed signifi- 
cant differences in favor of the majority. Of the 7 category B items, 
only 9 out of a possible 21 instances of differential performance occur 
favoring the majority group. 

When one looks at the comparison between L.A. Mexican-Americans 
and Blacks, two groups with great ethnic differences but which both occu- 
py minority status in the United States, we see only 2 instances of dif- 
ferential performances out of 2l* possible chances. Thus, two racially 
very distinct groups performed almost equally on the Letter Groups test, 
yet in comparison with another racially distinct group, which occupies 
majority status in this country, both the Blacks and Mexican-Americans in 
Los Angeles performed relatively more poorly. 

For the most part, items that were easy for the majority group were 
also easy for the minority groups. Conversely, items that were most diffi- 
cult for the majority group were also most difficult for the minority 
groups. Spearman rank order correlations ranged from . 9 U 6 to .962 across 
the various groupings. 



^Mean differences in item Deltas at the .01 probability level 
considered significant. 
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The following items (with their corresponding difficulty levels 
included) are those that proved to he the most consistent in displaying 
a greater discrepancy between racial groups: 

item 11, category D, Medium difficulty level 

item 16, category D, Medium difficulty level 

item 17, category C, Medium difficulty level 

item 18, category B, Medium difficulty level 

item 20, category C, Medium difficulty level 

item 5, category C, Medium difficulty level 

item 7, category D, Medium difficulty level 

Thus, the items which produced the widest discrepancies between 
racial groups were of medium difficulty, and all but one involved the 
alphabetical ordering of letters (categories C and D). 

Most of those items that produced the least discrepancy between these 
comparison groups were those in category B and therefore of Easy difficulty 
level. Of 7 category B items, 6 showed virtually no differences in perfor- 
mances between these racial groups. 

2. Comparisons by city . In this analysis, race was held constant 

while the effects of each city were compared within racial groups. Thus 
there were four comparison groups: 

(1) L.A. Blacks versus Memphis Blacks 

(2) L.A. Blacks versus D.C. Blacks 

(3) Memphis Blacks versus D.C. Blacks 

(H) L.A. Whites versus Memphis Whites 

Of 96 possible chances for item discrepancy there was a total of 6 l 
instances of significant differences. There were no trends in either item 
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category or difficulty level. The results of inter-city comparisons 
point to higher overall scores of D.C. Black students and Memphis White 
students. (See TablesIV and V.) 



3. Comparisons by sex . In this analysis, performance by sex was 

U 

looked at for all groups in which the data were available. The fol- 
lowing four comparisons were made: 



(1) 


L.A. Mexican-American: 


Male 


versus 


(2) 


Memphis Whites: 


Male 


versus 


Female 


(3) 


Memphis Blacks: 


Male 


versus 


Female 


(UJ 


D.C. Blacks: Male versus Female 



Out of a possible total of 93 chances for item discrepancies to occur 
between males and females, 26 showed significant differences. With the 
exception of Mexican-American students, all of these differences showed 
higher performance by females. Two items shoved sex differences for Mex- 
ican-American students, both in favor of males. None of these items showed 
any trend in terms of item category or difficulty level. 

Of the 26 significant differences, 11 were from the Memphis White sam- 
ples, and 9 were from the Memphis Black samples. Only one item (C20) showed 
an advantage for females over males in three of the four comparisons. (See 
Tables VI and VII.) 



h. Comparisons b y race and city . Since there was no White group in 
Washington with which to make racial comparisons, the results of the Wash- 
ington Blacks (which happened to be the best performing Black group) weri' 



Sex breakdowns for L.A. Blacks and Whites were not available. 

iv) 
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comp ared, in turn, to the two available White groups: the lower per- 

forming White group (L.A. Whites) and the better performing White group 
(Memphis Whites). 

Washington, D.C. Blacks performed significantly better than L.A. 

Whites on only two items, both of the B category (B12 and Bl8); L.A. 

Whites were significantly favored on only one item (C22). Out of a 
possible 2b chances for significant discrepancies to occur, there ex- 
isted only 3; otherwise it can be said that the two groups performed 
virtually equally as well. The D.C. Blacks versus Memphis Whites compar- 
ison indicated widely different performances by the two groups. Memphis 
Whites found a total of 21 items out of the possible 2b significantly less 
difficult. On two items there were no discrepancies (a 8 and C22), and 
D.C. Blacks performed better on one item (Bl8). (See Tables VIII and IX.) 

Summary of Results 

Results indicated that the majority group (Whites) fared better on 
the Letter Groups test than did minority groups ( Mexican-Americans or Blacks). 
The items causing the widest discrepancies in racial performance were items 
of Medium difficulty in categories C and D. The items on which the dichotomy 
in group performance was the narrowest between races were clearly those of 
Easy difficulty level in category B. 

When results are looked at by city, whether within race cr between race, 
the best performing group is Memphis Whites, and the second best is D.C. 
Blacks . 

Comparisons by sex indicated close performance patterns between males 
and females 5 but wherever significant differences did occur, it was, with two 
exceptions, the female who was favored. 
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DISCUSSION 

At first glance, one is tempted to say that the above findings indi- 
cate that group performances are strongly influenced hy the racial or 
ethnic membership of that group. But on closer inspection the results 
actually belie this to a certain extent. On the one hand, there were 
virtually no differences between the performance of Black and Mexican- 
American samples in Los Angeles, two very distinct and different ethnic 
groups. Perhaps belonging to a majority or a minority group is more impor- 
tant than membership in a particular ethnic group. On the other hand, 
there were practically no differences between the Los Angeles White and 
the D.C. Black samples. This leads one to conjecture that the differences 
found with other comparison groups are more than ' ’kely due to seme other 
factor, for example, socioeconomic status, since the selection process for 
participation in Project Access was different for each city. In Los Ange- 
les, a selected group of inner-city schools, characterized by low socio- 
economic status, participated in the study. Thus the Whites in the Los 
Angeles sample were a relatively homogeneous group, almost totally of the 
lower socioeconomic stratum. In this situation, where the social class of 
the races was more nearly equal (though probably still far from equal), the 
huge difference that was found, for example, between Memphis Whites and 
Blacks did not occur. The difference was much more moderate, and on one 
general classification of item — category B — there were no significant 
differences at all. 

In Memphis and Washington, on the other hand, virtually the entire 
school systems participated. This resulted in the inclusion of a large 
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number of White students from high socioeconomic backgrounds in the 
Memphis sample, and a large number of Blacks from high socioeconomic 
backgrounds in the Washington results. Socioeconomic factors, con- 
comitant with majority /minority status, rather than race (or city) 
can explain why Memphis Whites and D.C. Blacks were the two superior ^ 
performing groups. 

The results of this study have indicated a possible relation- 
ship between item category and performance by different socioeconomic 
groups on the Letter Groups test. Item category is, therefore , a vari- 
able that should be considered both during test construction and test 
interpretation. On the basis of the present results, it appears to be 
possible to reduce or widen the discrepancies in performance on the Let- 
ter Groups test between different groups by the way one selects items from 
the categories. For example, if more category B items and less category 
C items were used on this Letter Groups test, the result would be a nar- 
rowing of the gap between Whites and Blacks in Memphis, and Whites, Blacks, 
and Mexican-Americans in Los Angeles. 

In light of the findings of the present study, it seems advisable that 
the items on the Letter Groups test, and tests of related tasks, be evalu- 
ated in terms of difficulty level and category. The interaction between 
item category and item difficulty has not been clearly established since it 
is not known whether performance on those items of Medium difficulty was 
caused by some quality inherent in that level of difficulty or whether per- 
formance on Easy and Hard items was influenced by floor and ceiling 
effects respectively. It might be worthwhile to develop more items so 
that each category has a complete range of difficulty levels. Moreover, 
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since each item category represents a different cognitive task, it is 
incumbent upon test developers to define first the cognitive ability to 
be measured and then develop the items which best measure it. The test 
could then reflect those abilities that are of greatest value to educa- 
tors by including more items in those categories which best measure those 
particular abilities. 



SUGGESTIONS FOR FURTHER RESEARCH 

1. The present study should be replicated with one added feature: 
rather than making intuitive assumptions on the socioeconomic status of 
the subjects, Project Access biographical data should be utilized so that 
subjects can be identified and matched on critical socioeconomic variables, 
e.g., father's occupation, educational level, income, etc. Thus, a con- 
trol on socioeconomic status would be established which was not present in 
this study. 

2. The strategy used in this study, in which items were broken down 
into categories representing specific cognitive tasks, could be used to 
analyze performance on other tests. The purpose of this would be to see 
whether the relationship found was peculiar to inductive reasoning, in 
general, the Letter Groups test, in particular, or was generalizable to 
groip performance on tests of other abilities. 
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TABLE I 



HARD 

(13.1 - 16.6) 



MEDIUM 

(11.3 - 12.8) 



EASY 

( 8.1 - 10 . U) 



TOTAL 

ITEMS 



Item numbers are written in the Category x Difficulty cells; fre- 
quencies are written in the ,, Total"cells. The ranges of the mean 
Delta values are indicated in parentheses for each of the three 
levels of difficulty. 



CATEGORIES 



A 


B 


C 


D 


E 


TOTAL 

ITEMS 
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5, 9, 
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2, 7, 
11, 15, 
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6, 10, 
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7 
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PRODUCED BY LETTER GROUP ITEMS 
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An "x" indicates which group (row) was significantly higher than its 
counterpart on each item (column) at the .01 level of significance. 



TABLE III 



DELTA DIBFERENCES IN GROUP PERFORMANCE 
ON EACH ITEM - BY RACE 



Differences 




LOS ANGELES 




MEMPHIS 


Whites - 
Hex . -/'jn . 


Mex.-Am. - 
Blacks 


Whites- 

Blacks 


Whites - 
Blacks 


3.0 & above 








C17 , C5 


2.9 








MB. 


2.8 










2.7 








. 


2.6 








C14 


2.6 t 








D21 


2.4 








D1S 


2.3 










2.2 








B4, C9, B12, Dll 


2.1 










2.0 


D1 6 




C5 


T23 


1.9 






01 6 


Bl , 015, D7 “ 


l.B 






Cl 7 




1.7 


Cl 7, C20 




CT4, D7 


C3 


l.G 


C22, Dll 




C20 _ 
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C3, C9 
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B6 
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B18 
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D7 
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C19, C22 
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BIO, C19 
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B6, D1 5 
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-0.4 
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-0.5 










-0.6 




A8, CS, Bl 2 






-0.7 




C3 






-0.8 




ZZ2 






-0.9 










-1.0 & below 











KEY: Broken lines represent confidence Intervals. Positive differences refer to the group listed 
first in the comparison and indicate a lower Delta on that item for that group. Con- 
versely, negative differences indicate that the second-mentioned group had a lower Delta 
on that Item. For example. Item B6 In the comparison between L.A. Whites vs. Mexlcan- 
Americans was four-tenths of a point easier for Mexlcan-Amer leans than for the Whites. 
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An "x" indicates which group (row) was significantly higher than its 
counterpart on each item (column) at the .01 level of significance. 



TABLE V 
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DELTA DIFFERENCES IN GROUP PERFORMANCE 
ON EACH ITEM — BY CITY 



Differences 



3.0 A above 

2.9 

2.3 

2.7 

2.6 

2.5 

2.4 

2.3 

2.2 

2.1 

2.0 

1.9 

1.8 

1.7 

1.6 

1.5 

1.4 
1.3 
1.2 
1.1 
1.0 
0.9 
0.8 
0.7 
0.6 
0.5 
0.4 
0.3 
0.2 
0.1 

0 

- 0.1 

-J.2 

-0.3 

-0.4 

- 0.8 

- 0.6 

-0.7 

- 0.8 

-0.9 

-1.08 below 



Memphi s 
Blacks - 
L.A. 
Blacks 


Wash. D.C. 
Blacks - 
Memphis 
Blacks 


Wash. O.C. 
Blacks - 
L.A. 

Blacks 


Memphis 
Whites - 
L.A. 

Whi tes 
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Broken lines represent confidence intervals. Positive differences refer to the groups 
listed first in the comparison and indicate a lower Delta on that item for that group. 
Conversely, negative differences indicate that the second-mentioned group had a lower Delta 
on that item. For example, item C22 in the comparison between Memphis Blacks and L.A. 

Blacks was nine- tenths of a point easier for L.A. Blacks than for Memphis Blacks. 
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OCCURRENCES OF STATISTICAL SIGNIFICANCE 
PRODUCED BY LETTER GROUP ITEMS 
BY SEX 
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An "x" indicates which group (row) was significantly higher than its 
counterpart on each item (column) at the .01 level of significance. 
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TABLE VII 

DELTA DIFFERENCES IN GROUP PERFORMANCE 
ON EACH ITEM — BY SEX 



r 

Differences 
3.0 & above 


L.A. Mex.- 
Amer. 

Males - 
Females 


Memphis 
Mhi tes 
Females - 
Males 


Memphis 
Blacks 
Females - 
Males 


Wash.D.C. 

Blacks 
Females - 
Males 


2.9 










2.8 










2.7 










2.6 










2.5 










2.4 










2.3 










2.2 










2.1 










2.0 










1 .9 


86 








1 .o 










1.7 










1.6 










1 . 5 


B12 








1.4 




C20 1 






1.3 










1.2 


C14, C19 








1.1 










1.0 


B4, D15 








0.9 


C17 


B18 


813 




0.3 


D7 


016 




B18, C20, E23 


0.7 


813, C20 


84, B12, 813, D24 


812 




0.6 


"DT6 


B 1 9 , C19 


C19, C20 


A8 


0.5 


81 


D21 


A8, B6, Dll 




0.4 


~UT\ 


A3, C9, C22, B2 


£3, C9 


Bl2, bT3, T9T C22, A?4 


0.3 


U2 


C5 , Cl 7, U7 , E23 


D15, D?1 , £23 


C14, Cl 7, C 1 9 , 07. Dll , 016 1 


0.2 


A8 


86 






0.1 




C3, C14 


BIO, Cl 7 , 012, D7 , D16 


02 


0 






~bT^ 


C5 


-0.1 


C3 


81 


818, C5, C14, C22 


B6, C3 , 015 


-0.2 


B18, C5 




B4.D24 


B11, B4 , BIO. D2l 


-0.3 


BIO, Dll 








-0.4 










-0.5 










-0.6 


T5 








-0.7 










-0.8 










-0.9 
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KEY: broken lines represent confidence intervals. Positive differences refer to the group 

listed first in the comparison and indicate a lower Delta on that item for that group. 
Conversely, negative differences indicate that the second-mentioned group had a lower 
Delta on that item. For example, item C9 in the comparison between L.A. Mexican-American 
Males and Females was six-tenths of a point easier for the Females than for the Males. 
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TABLE IX 

DELTA DIFFERENCES IN GROUP PERFORMANCE 
ON EACH ITEM — BY RACE AND CITY 



Differences 

3.0 & above 

2.9 

2.8 

2.7 

2.6 

2.5 

2.4 

2.3 

2.2 

2.1 
2.0 

1 .9 

1.8 

1 .7 

1.6 

1.5 

1.4 
1.3 
1.2 
1.1 
1.0 
0.9 
0.8 
0.7 
0.6 
0.5 
0.4 
0.3 
0.2 
0.1 

0 

- 0.1 

- 0.2 

-0.3 

-0.4 

-0.5 

- 0.6 

-0.7 

- 0.8 

-0.9 

-1 .0 & below 



L.A. Whites - 
D.C. Blacks 


Memphis Whites - 
D.C. Blacks 
































Cl 7 




C14 




C5 












D24 




Dl6 












C3, C20, D7 1 




Bl, D21 








B4, B13. C9, D2 


_C22 
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D15, E23 
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B6, BIO 


C5 




07 j 
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D21 
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C9, Dll, E23 
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A8, B13, Cl 9 












D2, D15 








B1 




B4, B6 












B12, B18 I 


B18 
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KEY: Broken lines represent confidence Intervals. Positive differences refer to the 

group listed first in the comparison and indicate a lower Delta on that item for that 
group. Conversely, negative differences indicate that the secondnnentioned group 
had a lower Delta on that item. For example, item B1 in the comparison between L.A. 
Whites and D.C. Blacks was six-tenths of a point easier for D.C. Blacks than for the 
L.A. Whites. oa 



